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0 Method and apparatue for preprocessing multiple Instructions In s pipeline processor. 



® To increase the performance of a pipelined processor executing various classes of instructions, the classes 
of instructions are executed by respective functional unit3(164-i67) which are independently controlled and 
^operated in parallel The classes of instructions include integer instructions (164) floating point instructions (185), 
^multiply instructions (168), and divide instructions (181). The integer unit which also performs shift operations, is 
controlled by the microcode execution unit (28) to handle the wide variety of integer and shift operations 
included in 4 complex, variable-^ngth instruction set The other functional units need only accept a control 
^command to initiate the operation to be performed by the functional unit The retiring of the results of the 
instructions need not be controlled by the microcode execution unit but Instead is delegated to a separate retire 
J unit (173) that services a result queue (172). When the microcode execution unit determines that a new 
^operation is required, an entry is inserted into the resutt queue. The entry includes ail the information neeced by 
the retire unit to retire the result once the result is available from the respective functional unit The retire unit 
° services the result queue by reading a tag In the entry at the head of the queue to determine me functional unit 
&that is to provide the result Once the resutt is available and the destination specified by me entry is also 
UJ available, me result is retired in accordance with me entry, and me entry is removed from me queue. 
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MffTHOO ANO APPARATUS FOR PREPROCESSING MULTIPLE INSTRUCTIONS IN A PIPELINE PROCES- 
SOR 

The present invention relates generally to digital computers and. more particularly, to a system for 
resoiving data dependencies during the preprocessing of multiple instructions prior to execution of those 
instructions in a digital computer. This invention is particularly applicable to the preprocessing of multiple 
instructions in a pipelined digital computer system using a variable-length complex instruction set (CIS) 
s architecture. 

Preprocessing of instructions is a common expedient used In digital computers to speed up the 
execution of targe numbers of instructions. The preprocessing operations are typically carried out by an 
instruction unit interposed between the memory that stores the instructions and the execution unit that 
executes the instructions. The preprocessing operations include, for example, the prefetching of operands 

to identified by operand specifiers in successive instructions so that the operands are readily available when 
the respective instructions are loaded into the execution unit The instruction unit carries out the preproces- 
sing operations for subsequent instructions wnile a current instruction is being executed by tie execution 
unit, thereby reducing the overall processing time for any given sequence of instructions. 

(Designers often separate instructions into classes, and design dedicated hardware optimized for each 

rs class. This dedicated hardware almost invariably is microcoded. This is done because complex instructions 
require a regular, yet flexible datapath that can be used repeatedly to perform the intricate operations 
required by complex instructions. The exact operations are often data dependent requiring microcode 
interpretation. The common microcode implementation is to issue an instruction, fetch source operands, 
execute, and store results. The execution has been done with single threaded microcode, and the functional 

so units have been controlled in serial fashion by sucn microcode. 

To increase the performance of a pipelined processor executing various classes of instructions, the 
classes of instructions are executed by respective functional units which are operated in parallel The 
classee of instructions having the separate function si units include integer instructions. ffc -jng point 
instructions, multiply instructions, and divide instructions. 

js Thus, according to the present invention there is provided a method of preprocessing and executing 
multiple instructions in a pipelined processor, the instructions including opcodes and operand specifiers, the 
pipelined processor including multiple and separate functional units for executing various classes of 
instructions, the method comprising: 

decoding the instructions to obtain the opcodes and operand specifiers; 

jo fetching source operands specified by the operand specifiers; 

issuing the source operands to the respective functional units as indicated by the decoded opcodes, and 
operating the functional units in parallel to execute the various classes of instructions; and 
retiring results from the respective functional units. 

Preferably, the cycte-by-cycie operations of the various functional units are independently controlled. 

35 Only the integer unit has its cycie-cy<yde operations microcontroiled by the microcode execution unit in 
the instruction execution unit The integer unit which also performs shift operations, may be controlled by 
the microcode execution unit to handle the wide variety of integer and shirt operations included in a 
complex variable- length instruction set The other functional units may accept microcode commands, but 
their cycie-by-cycie operations need not be microcode controlled. Instead, the other functional units need 

to only accept a control command which is an encoding of the instruction opcode, that specifies to the 
functional unit the specific operation to perform. In a pipelined functional unit such as the floating point unit, 
this control command may be pipelined atcng with the data, and can be modified slightly as the pipelined 
operations take place to reflect data dependencies. 

Preferably, the retiring of the results of the instructions is not controlled by the microcode execution 

*s unjt. but instead is delegated to a separate retire unit that services a result queue. When the micrcccce 
execution unit determines that a new operation is required, the respective functional unit is not busy, the 
source operands are available, and the destination for the result is known, then an entry is inserted Into the 
result cueue. The entry should include all the information needed by the retire unit to retire the resuit once 
Tie result is available from the respective functional unit 

50 The retire unit may service the result queue by reading a tag in the entry at the head of the queue to 
determine the functional unit that is to provide the result Once the result is available and the destination 
specified by the entry is also available, the result is retired in accordance with the entry, and the entry is 
removed from the queue. 

Preferably the operations are queued in the result queue, and the results retired, in the sequence in 
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which the coiresponding instructions appear in the instruction stream. This helps decouple the task of 
decoding source specifier*, fetching source operand* and storing result* from microcode. The issuing and 
rearing of instructions need not be controlled by the microcode, only "allowed" or 'disallowed", thus when 
microcode is not doing anything thai precludes execution in me other units, like interruot handling, the other 
s units are allowed to proceed on their own. 

According to another aspect of the invention there is provided a pipelined processor for preprocessing 
and executing multiple instructions, the instructions including opcodes and operand specifiers, the proces- 
sor including means for decoding the instructions to obtain the opcodes and the operand specifiers, means 
for fetching source operands specified by the operand specifiers, multiple and separate functional units for 
to executing various classes of the instructions, means responsive to the decoded opcodes for issuing 
commands and source operands to the respective functional units to initiate parallel execution of the various 
classes of instructions, and means for retiring results from the respective functional units. 

in one particular form the invention provided a pipelined processor for preprocessing and executing 
multiple instructions, the instructions including opcodes and operand specifiers, the processor including 
is means for decoding the instructions to obtain the opcodes and the operand specifiers, means for fetching 
source operands specified by the operand specifiers, multiple and separate functional units for executing 
various classes of instructions, a result queue for queuing entries identifying respective ones of the 
functional units and respective destinations for their results, a mi cr o co de controlled issue unit responsive to 
the decoded opcodes for issuing commands and source operands to the functional units and inserting 
20 corresponding entries into the result queue when the respective destinations are known, and a retire unit 
separate from said issue unit for retiring respective results from the respective functional units to 
destinations indicated by the entries inserted into the result queue. 

The present invention can be put into practice in several ways one of which will now be described by 
way of example with reference to the accompanying drawings in which: 
23 FIG. 1 is a block diagram of a digital computer system having a central pipelined processing unit 

which employs the present invention; 

FIG 2 is a diagram showing various steps performed to process an instruction and which may be 
performed in parallel for different instructions by a pipelined instruction processor according to FIG. 1: 

FIG 3 is a block diagram of the instruction processor of FIG. 1 showing in further detail the queues 
zo inserted between the instruction unit and the execution unit 

FIG. 4 is a block diagram of the instruction decoder in FIG. 1 snowing in greater detail the data paths 
associated with the source list and the other registers that are used for exchanging data among the 
instruction unit the memory access unit and the execution unit; 

FIG. 5 is a block diagram showing the data path through the instruction unit to the queues; 
25 FIG. 6 is a diagram showing the format of operand specifier data transferred over a GP bus from an 

instruction decoder to a general purpose unit in an operand processing unit in the instruction unit 

FIG. 7 is a diagram showing the format of short literal specifier data transferred over a SL bus from 
the instruction decoder to an expansion unit In the operand processing unit 

FIG. 8 is a diagram showing the format of source and destination specifier data transmitted over a TR 
40 bus from the instruction decoder to a transfer unit in the operand processing unit 
FIG. 9 is a schematic diagram of the source pointer queue; 
FIG. 10 is a schematic diagram of the transfer unit 
FIG. 1 1 is a schematic diagram of the expansion unit 

FIG. 12 Is a schematic diagram of the general purpose unit in the operand processing unit 
«s FIG. 13 is a block diagram of the execution unit which shows the control flow for executing 

instructions and retiring results; 

FIG. U is a block diagram of the execution unit which shows the data paths available for use during 
the execution of instructions and the retiring of results; 

FIG. 15 is a timing diagram showing the states of respective functional units when performing their 
to respective arithmetic or logical operation* upon source operands of various data types; 

FIG. 18 is a flowchart of the control procedure followed by an Instruction issue unit in the execution 
unit for issuing source operands to specified functional units and recording the issuance and the destination 
for the resoective result in a result queue in the execution unit 

FIG. 17 is a flowchart of the control procedure followed by the retire unit for obtaining the results of 
55 the functional unit specified by the entry at the head of the retire queue, and retiring those results at a 
cesti nation specified by that entry, and removing that entry from the head of the result queue; and 

FIG. 13 is a diagram showing the information that is preferably stored in an entry of the result queue. 
While the invention is susceptible to various modifications and alternative forms, specific embodiments 
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thereof have been shown by way of example in the drawings and will be described in detail herein, ft should 
ce understood, howew, that it is not intenced to limit the invention to the particular forms disclosed, but on 
the contrary, the intention ia to cover all modifications, equivalents, and alternatives failing within the scope 
of the invention as defined by the appended claims. 

5 Turning now to the drawings and referring first to FK3. 1 . there is shown a portion of a digital computer 
system which includes a main memory 10. a memory-CPU interface unit it, and at least one CPU 
comprising an instruction unit 12 and an execution unit 13. It should 15 be understood that additional CPUs 
coutd be used in such a system by sharing the main memory to. tt is practical, for example, for up to four 
CPUs to operate simultaneously and communicate efficiently through the shared main memory 10. Both 

}Q data and instructions for processing the data are stored in addressable storage locations within the main 
memory 10. An instruction includes an operation code (opcode) that specifies, in coded form, an operation 
to be performed by the CPU. and operand specifiers that provide information for locating operands. The 
execution of an individuai instruction is broken down into multiple smaller tasks. These tasks are performed 
by dedicated, separate, independent functional units that are optimized for that purpose. 

is Although each instruction ultimately performs a different operation, many of the smaller tasks into which 
each instruction is broken are common to ail instructions. Generally, me following steps are performed 
during the execution of an instruction: instruction fetch, instruction decode, operand fetch, execution, and 
result store. Thus, by the use of dedicated hardware stages, the steps can be overlapped in a pipelined 
operation, thereby increasing the total instruction throughput 

20 The data path through the pipeline includes a respective set of registers for transferring the results of 
each pipeline stage to the next pipeline stage. These transfer registers are clocked in response to a 
common system clock. For example, dunng a first dock cycle, the first instruction is fetched by hardware 
dedicated to instruction fetch. Ouhng the second clock cycle, the fetched instruction is transferred and 
decoded by instruction decode hardware, but at me same time, me next instruction is fetched by the 

25 instruction fetch hardware. During the third ciock cycle, each iristruction is shifted to me next stage of the 
pipeline and a new instruction is fetched. Thus, after the pipeline is filled, an instruction will be completely 
executed at me end of each ciock cycle. 

This process is analogous to an assembly line in a manufacturing environment Each worker is 
dedicated to performing a single task on every product that passes through his or her work stage. As each 

jo task is performed the product comes closer to completion. At the final stage, each time the worker performs 
his assigned task a completed product rolls off the assembly line. 

in the particular system illustrated in PIG. 1, the interface unit 11 includes a main cache 14 which on an 
average basis enables me instruction and execution units 12 and 13 to process data at a faster rate man me 
access time of the main memory 10. This cache 14 includes means for storing selected predefined blocks 

is of data elements, means for receiving requests from me instruction unit 1 2 via a translation buffer 15 to 
access a specified data element means for checking whether me data element is in a block stored in me 
cache, and means operative when data for the block including the specified data element is not so stored 
for reading the specified block of data from the main memory 10 and storing mat block of data in me cache 
1 4. In other words, the cache provides a Vindow* into the main memory, and contains data likely to be 

40 needed by me instruction and execution units. 

If a data element needed by me instruction and execution units 1 2 and 13 Is net found in the cache U. 
men the data element is obtained from the main memory 10, but in the process, an entire block, including 
additional data, is obtained from the main memory 10 and written into the cache 14. Due to me principle of 
locality in time and memory space, the next time the instruction and execution units desire a data element 

4$ mere is a high degree of likelihood mat this data element will be found in me block which includes me 
previously addressed data element Consequently, mere is a high degree of likelihood mat the cache 14 will 
already include me data element required by the instruction and execution units 1 2 and 13. In general, 
since me cache 14 will be accessed at a much higher rate man me main memory 10, me main memory can 
have a proportionally slower access time than me cache without substantially degrading the average 

so performance of me data processing system. Therefore, me main memory 10 can be comprised of slower 
and less expensive memory elements. 

The translation buffer 15 is a high speed associative memory which stores me most recentty used 
virtuaMo-physicai address translations. In a virtual memory system, a reference to a single virtual address 
can cause several memory references before me desired information is made available. However, where me 

33 translation buffer 15 is used, translation is reduced to simply finding a "hit - In me translation buffer 15. 

An UO bus 18 is connected to me main memory 10 and me main cache 14 for transmitting commands 
and input data to the system and receiving output data from me system. 

The instruction unit 12 induces a program counter 1 7 and an instruction cache 18 for fetching 
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instructions from the main cache 14. The program counter 17 preferably addresses virtual memory 
locations rather than tha physical mamory locations of the main memory 10 and the cacha 14. Thus, tha 
virtual addraaa of the program counter 17 mutt ba translated into the physical addreea of the main memory 
10 before instructions can be retrieved. Accordingly, me contents of the program counter 17 are transferred 

5 to me interface unit 11 where the translation buffer is performs the address conversion. The instruction is 
retrieved from its physical memory location in the cache U using the converted address. The cache 14 
delivers the instruction over data return fines to the instruction cache id. The organization and operation of 
tha cache i a and the translation buffer 1 5 are further described in Chaoter 1 1 of Levy and Eckhouse. Jr.. 
Computer Programming and Architecture. The VAX- » 1 . Digital Equipment Corporation, pp. 351*368 (1980). 

io Most of the time, tha instruction cache has prestored in it instructions at the addresses specified by the 
program counter 1 7, and the addressed instructions are available immediately for transfer into an instruction 
buffer 19. From the buffer 19, the addressed instructions are fed to an instruction decoder 20 which 
decodes both the op-codes and the specifiers. An operand processing unit (OPU) 21 fetcnes the specified 
operands and supplies them to the execution unit 13. 

is The OPU 21 also produces virtual addresses. In particular, the OPU 21 produces virtual addressee for 
memory source (read) and destination (write) operanda. For at least the memory read operands, the OPU 
21 must deliver these virtual addresses to the interface unit 11 where they are translated to physical 
addressee. The physical memory locations of the cache 14 are then accessed to fetch the operands for the 
memory source operands. 

so in each instruction, the first byte contains the opcode, and the following bytes are the operand 
specifiers to be decoded. The first byte of each specifier indicates the addressing mode for that specifier. 
This Oyte is usually broken in halves, with one half specifying the addressing mode and the other half 
specifying a register to be used for addressing. The instructions preferably have a variable length, and 
various types of specifiers can be used with the same opcode, as disclosed in Strecker et ai., U.S. Patent 

25 4.241 .397 issued December 23. 1980. 

The first step in processing the instructions is to decode the 'opcode" portion of the instruction. The 
first portion of each instruction consists of its opcode which specifies the operation to be performed in the 
instruction. The decoding is done using a taole-tock-up technique in the instruction decoder 20. The 
instruction decoder finds a microcode starting addreea for executing the instruction in a look-up table and 

2Q passes the starting address to the execution unit 13. Later, the execution unit performs the specified 
operation by executing prestored microcode, beginning at the indicated starting address. Also, the decoder 
determines where source-operand and destination-operand specifiers occur in the instruction and passes 
these specifiers to the OPU 21 for pre-processing prior to execution of the instruction. 

The look-up table ia organized as an array of multiple blocks, each having multiple entries. Each entry 

:s can be addressed by its block and entry index. The opcode byte addresses the block, and a pointer from 
an execution point counter (indicating the position of the current specifier in the instruction) selects a 
particular entry in the block. The output of the lookup table specifies the data context (byte. word, etc.), data 
r/pe (address, integer, etc.) and accessing mode (read, write, modify, etc.) for each specifier, and also 
provides a microcode dispatch address to the execution unit 

40 After an instruction has been decoded, the OPU 21 parses the operand specifiers and computes their 
effective addresses: this process involves reading GPRa and possibly modifying the GPR contents by 
autoincrsmenting or autodecr e me n ting. The operanda are then fetched from those effective addresses and 
passed on to the execution unit 13. which later executes the instruction and writes the result Into the 
destination identified by the destination pointer for that instruction. 

4* Each time an instruction is passed to the execution unit the instruction unit sends a microcode dispatch 
address and a set of pointers for (1) the locations in the execution-unit register file where the source 
operanda can be found, and (2) the location where the results are to be stored. Within the execution unit s 
set of queues 23 includes a fork queue for storing the microcode dispatch address, a source pointer queue 
for storing the source-operand locations, and a destination pointer queue for storing the destination location. 

50 Each of these queues is a FIFO buffer capable of holding the data for multiple instructions. 

The execution unit 13 aieo includes a source list 24. which is a multi-ported register file containing a 
copy of the GPRs and a list of source operands. Thus, entries in the source pointer queue will either point 
to GPR locations for register operands, or point to the source list for memory and literal operands. Both the 
interface unit 11 and the instruction unit 12 write entries in the source list 24, and the execution unit 13 ' 

ss reads operands out of the source list as needed to execute the instructions. For executing Instructions, the 
execution unit 13 includes an instruction issue unit 25, a microcode execution unit 29. an arithmetic and 
logic unrt (ALU) 22. and a retire unit 27. 

The present invention ia particularly useful with pipelined processors. As discussed above, in a 
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pipelined processor the processor's instruction fetch hardware may be fetching one instruction «m.ie other 
hardware is decoding the ooeration code of a second instruction, fetching tne operands of a third 
instruction, executing a fourth instruction, and storing the processed data of a fifth instruction. FIG. 2 
illustrates a pipeline for a typical instruction such as: 
s AOOL3 R0.B*12{R1).R2. 

This is a long-word addition using the displacement mode of addressing. 

in the first stage of the pipelined execution of this instruction, the program count (PC) of the instruction 
is created: this is usually accomplished either by incrementing the program counter from me previous 
instruction, or by using the target address of a branch instruction. The PC is then used to access the 
fo instruction cache 18 in the second stage of the pipeline. 

In the third stage of the pipeline, me instruction data is available from me cache 18 for use by me 
instruction decoder 20. or to be loaded into the instruction buffer 19. The instruction decoder 20 decodes 
me opcode and the three specifiers in a angle cycle, as will be described in more detail below. The Ri 
numoer along with me byte displacement is sent to me CPU 21 at me end of me decode cycle. 
;s in stage 4 the RO and R2 pointers are oassed to me queue unit 23. Also, me operand unit 21 reads me 
contents of its GPR register file at location Hi. adds mat value to me specified displacement 02) and 
sends me resulting address to the translation buffer 1 3 in me interface unit n. along with an OP READ 
request at me end of me address generation stage. A pointer to a reserved location in me source list for 
receiving the second operand is passed to me queue unit 23. When me OP READ request is acted upon, 
me second operand read from memory is transferred to me reserved location in me source list 

In stage 5. me interface unit 11 uses the translation buffer 15 to translate me virtual address generated 
in stage 4 to a physical address. The physical address is men used to address me cache H. *hicn is read 
in stage 8 of me pipeline. 

in stage 7 of me pipeline, the instruction is issued to me ALU 22 which adds me two operands and* 
sends the result to me retire unit 27. Ouring stage 4. me register numbers for RO and R2. and a pointer to 
me source list location for the memory data, were sent to me execution unit and stored m me pointer 
queues. Then during me cache read stage, me execution unit started to took for the two source operands m 
• me source list in this particular example, it finds only me register data in RO. but at the end of m.s stage 
me memory data arrives and is substituted for the invalidated read-out of me register file. Thus bom 
30 operands are available in me instruction execution stage. 

in me retire stage 8 of me pipeline, me result data is paired with me next entry in me result queue. Also 
at mis time, me condition codes, upon which me branch decisions are based, are available. Although 
several functional execution units can be busy at the same time, only one instruction can be retired <n a 

is SinQ !n me^iast stage 9 of the illustrative pipeline, me data is written into me GPR portion of me register files 
in bom the execution unit 13 and me instruction unit 12. 

rt is desirable to provide a pipelined processor with a mechanism for predicting me outcome of 
conditional branch decisions to minimize the impact of stalls or -gaps" in me pipeline. This is especially 
important for the pipelined processor of FK3. 1 since the queues 23 may store me intermediate results of a 

40 multiplicity of instructions. When stalls or gaps occur, the queues lose their s«ectiveness in ^reasmg , the 
throughput of the processor. The depth of the pipeline, however, causes the 'unwinding of an instrueoon 
sequence in the event of an incorrect prediction to be more costly in terms of hardware or execution time. 
Unwinding entails me flushing of me pipeline of information from instructions in me wrong path following a 
branch mat was Incorrectly predicted, and redirecting axecutior, along me correct path. 

45 As shown inRat, me instruction unit 12 of me pipeline processor is provided with a branch prediction 
unit 2a The specific function of the branch prediction unit 28 is to determine or select a vaiue 
(PREDICTION PC) that the program counter 17 assumes after having addressed a branch instruction. This 
value or selection Is transmitted over a bus 29 from me branch prediction unit 23 to the program counter 

so ^^The branch prediction unit 28 rss^onCs to four major input signals. When me instruction decoder 20 
receives a branch opcode from me instruction buffer 19, branch opcode information and a cranch opcode 
strooe s»gnai (BSHOP) are transmitted over an input bus 30 to me branch prediction unit At me same ome. 
me address of the branch instruction (OECOOE PC) is received on an input bus 31 from me program 
counter unit 17. The target address of me branch instruction (TARGET PC) and a target address scrcce 

» signal (TARGET VALID) are received on an input bus 32 from the operand unit 21 . The operand unit 2 ^or 
examp*. adds me value of a displacement specifier In me branch instruction to me address of me 
instruction following me branch instruction to compute me target address. ^ t ^^^^J^ 
branch decision is made, and me prediction is validated, by. a validation signal (BRANCH VALlO) received 
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Mth a data signal (BRANCH DECISION) on a bus 33 from the execution unit 13. 

Ouring the execution of most instruction sequences, trie branch prediction unit 28 first receives a 
branch opcode and its corresponding address, next receives the corresponding target address, and finally 
receives a validation signal The branch prediction unit 28 responds to mis typical sequence Oy making a 

s oranch prediction as soon u ma branch opcode and its corresponding address are received. 

if a conditional branch instruction is validated, men execution continues normally. Otherwise, when me 
branch decision disagrees with me prediction, an 'unwind* operation is performed. This involves recording 
tfie decision in me branch history cache and men redirecting me instruction stream. The instruction stream 
is redirected by restoring me state of the central processing unit to me state which existed at me time me 

jo prediction was made, and then restarting execution at me beginning of me alternate execution path from me 
branch instruction. Execution is restarted, for example, at the previously saved "unwind" address (UNWIND 
PC). The construction and operation of the preferred branch prediction unit is further described in me above 
referenced 0. Re et al. U.S. patent application Ser. No. 306.760. Hied 2188. and entitled *3ranch 
Prediction." which is incorporated herein by reference. 

;5 The instruction decoder 20 in the instruction unit 1Z and me queues 23 in me execution unit 13. are 
shown in mens detail in FIG. 3. It can be seen that the decoder 20 inciudes a decoder 20a for me program 
counter, a fork table RAM 20b* two source-operand specifier decoders 20c and 20d. a destination-operand 
specifier decoder 20e. and a register-operation decoder 20f which wit! be described in detail be low. in a 
preferred embodiment the decoders 20c - 20f are intimately interlinked and integrated into a large complex 

20 decode unit as further described in me above referenced Fite at al. U.S. patent application Ser. No. 
307.347. filed 2^*89. entitled "Decoding Multiple Specifiers in a Variable Length Instruction Architecture.* 
incorporated herein by reference. The decoder 20b is preferably located in the execution unit next to me 
fork queue 23b instead of in the instruction unit because the forte addresses include more bits man me 
oocodes. and therefore fewer data lines between the instruction unit and me execution unit are required in 

25 mis case. , 

The output of me program-counter decoder 20a ia stored in a program counter queue 23a in the 
execution unit 13. The RAM 20b receives onty the opcode byte of each instruction, and uses mat data to 
select a "forx" (microcode) dispatch address from a table. This dispatch address identifies the start of me 
microcode appropriate to me execution of me instruction, and is stored in a fork queue 23b in me execution 

30 unit 13. 

Each of the four decoders 20c-20f receives bom the opcode byte and me operand specifier data from 
me instruction buffer 19. The decoders 20c and 20d decode two source-operand specifiers to generate 
source-operand pointers which can be used by the execution unit to locate me two source operands. These 
two pointers are stored in a source-pointer queue 23c in me execution unit The destination-operand 

js specifier is decoded by me decoder 20e to generate a destination-operand pointer which is stored in a 
destination-pointer queue 23e in me execution unit 

In order to check for the register confBcts discussed above, a pair of masks are generated each time a 
new instruction is decoded, to identify all GPRs that the execution unit will read or write during me 
execution of that Instruction. These masks are generated in me register-operation decoder 20f (described 

40 below in connection with FK3. 4) and are stored in a mask queue 23f in the instruction unit Each mask 
comprises a number of bit positions equal to the number of GPRs. In the read mask, a bit is set for each 
GPR to be read during execution of me new instruction, and in me write mask, a bit is set for each GPR to 
be written during execution of that instruction. 

6cm me read and write masks for a given instruction are stored as a single entry in the mask queue 

46 23f. When there are fifteen GPRs, each entry in the mask queue consists of thirty bits (fifteen cits in each 
read mask to identify GPRs to be read and fifteen bits in each write mask to identify GPRs to be written). 
The composite of ail the valid masks in me mask queue 231 is used to check each register to be used to 
sroduce a memory address during me preprocessing of instructions in me instruction unit 12 to determine 
whether me preprocessing of mat instruction should be stalled. The preferred construction and operation of 

so me mask queue 23f is further described in the above referenced Murray at ai. U.S. application Ser. No. 
306.773. filed 2/3/89. and entitled "Multiple Instruction Processing System With Oata Dependency Resciu- 
3" on,* which ia incorporated herein by reference. 

This reference also shows in detail the basic construction of a queue, including its insert pointer, its 
remove pointer, logic for detecting when the queue is full, and logic for flushing the queue. 

u Turning now to RG. 4, there is shown a more detailed block diagram of me source list 24 and related 
register files collectively designated 40. which are integrated together in a pair of self-timed register file 
integrated circuits. This self-timed register file 40 provides the data Interface between me memory access 
unit 11. instruction unit 12 and execution unit 13. 
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Preferably, the register file 40 includes four sets of sixteen registers with each register being 36-bits in 
length, in this case, two of the same kind of integrated circuits are used in combination to provide the four 
sets of sixteen 36-bit registers. Each register is configured to contain four bytes plus a parity bit for each 
byte. The four sets respectively correspond to GPRs 41 . the source list 24, memory temporary registers 42 
j and execution temporary registers 43. These register* have dual-port outputs and include a pair of 
multiplexers 45. 46 having their inputs connected to each of the sixteen registers in each of the four sets of 
registers. The 36-bit multiplexer outputs are connected directry to the execution unit 13. Select lines are 
connected between the execution unit 1 3 and the select inputs of the multiplexer 45. 46. These select tines 
provide a 8-bit signal to allow addressing of each of the sixty-four individual registers. The inputs to eacn of 
to the registers 41. 24, 42. 43 are also of the dual-port variety and accept both A and 3 data inputs. However, 
it should be noted that while the four sets of registers are each of the dual-pert variety, the register file 40 
receives inputs from three distinct sources and routes those inputs such that no more than two inputs are 
delivered to any one of the four sets of registers. 

As introduced aoove. the source list 24 is a register file containing source operands. Thus, entries in me 
'5 source pointer queue of the execution unit 13 point to the source list for memory and immediate or literal 
operands. Both the memory access unit 11 and the instruction unit 12 write entries to the source list 24. 
and the execution unit 13 reads operands out of the source list as needed to execute the instructions. 

The GPRs 41 include sixteen general purpose registers as defined by the VAX architecture. These 
registers provide storage for source operands and the results of executed instructions. Fur^mr, the 
20 execution unit 13 writes results to the GPRs 41, while the instruction unit 13 updates (he GPRs 41 for 
autcincrement and autodecrement instructions. 

The memory temporary registers 42 include sixteen registers readable by the execution unit 13. The 
memory access unit 1 1 writes into the memory temporary registers 42 data requested by the execution unit 
13. Further, the microcode execution unit 26 may also write to the memory temporary registers as needed 
2% during microcode execution. 

The execution temporary registers 43 include sixteen registers accessible by the execution unit 13 
alone. More specifically, the microcode execution unit 13 uses the execution temporary registers 43 for 
intermediate storage. 

The execution unit 13 is connected to the GPRs 41. the memory temporary register 4Z and the 

M execution temporary register 43 via a 36-bit data bus. Transmission gates 47. 43 and 49 respectively 
control the data delivered from the execution unit data bus to the GPRs 41, memory temporary registers 42, 
. and execution temporary register 43 via a 9-bit select bus connected to the select inputs of the 
transmission gates 47. 46 and 48. Similarly, the instruction unit 12 is connected to the B inputs of GPRs 41 
and source list 24 via transmission gates 50. 51. in this case* however, the select lines of the transmission 

35 gates SO. 51 are separate from one another and are controlled independently. 

The memory access unit 11 has a 72-bit data bus and. thus, preferably writes to a pair of 36-bit 
registers. Therefore, the bus is split into a low order 36-bit portion and a high order 36-bit portion to allow 
the oata to be stored at consecutive register addresses. The low order 36-bits are delivered to either the 
source list 24 through transmission gate 53. or, through transmission gate 53 to the memory temporary 

< register 42. Physically, in the preferred implementation introduced above using two of the same kind of 
integrated circuits, the higher-order 1 8 bits of each 36 bit portion are stored in one of the integrated circuits, 
and the corre sp on di ng lowerorder 18 bits of the 36 bit portion are stored on the other integrated circuit 

The memory access unit 11 also delivers a 6-bit select bus to the transmission gates 52. 53. The 
additional bit Is used to ailow the memory access unit 1 2 to write the high order 36-bits being delivered to 

45 the next sequential register of either the source list 24 through transmission gate 52. or through 
transmission gate 53 to the memory temporary register 42. Thus, the high order 36-bits are stored in either 
the source list 24 or the memory temporary register 42 at a location one greater than the low order 36-bits 
stored in the same register. Therefore, when the execution unit 13 retrieves the data stored in tie source 
list and memory temporary registers 24, 42 it first retrieves the data stored in the low order 36-bits, 

so increments its internal pointer, and then retrieves the high order 36-bits. 

Turning now to FIG. 5. the data path through the instruction unit is shown in greater detail. The 
instruction decoder 20 has the ability to simultaneously decode two source specifiers and one destination 
specifier. During a clock cycle, one of the source specifiers can be a short literal specifier. In this case the 
decoded short literal is transmitted over an EX bus to an expansion unit that expands the short literal to cne 

sa or more 32-bit tangwerds sufficient to represent or convert that short literal to the data type specified for 
that specifier for the instruction currently being decoded. 

The instruction decoder has the ability to decode one 'complex* source or destination specifier during 
each clock cycle. By complex, it is meant that the specifier is neither a register specifier nor a snort literal 
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seeafier. A complex specifier, for example, may include a base register number, an index register number, 
and a displacement and can have various modes such as immediate, aosctute. deferred, and me 
automcrement and autodecremertt modes. Evaluation of complex specifiers for some of these mode* 
requires address computation and a memory read operations, wnicn are performed by a GP or address 

s computation unit 82. 

For the evaluation of a branch displacement or immediate data (i.e.. a long literal found in the 
instruction stream), it is not necessary for the GP unit to initiate a memory read operation, tn the case of a 
brancn displacement the GP unit transmits the displacement directly to the branch prediction unit (28 in 
FIG. i ). For immediate data, the GP unit transmits the data to the source list 24. Since the source list has a 

to single port available tor the operand processing unit 21. a multiplexer 60 is included in the operand 
processing unit for selecting 32 -bit words of data from either the GP unit 82 or the EXP unit 81. Prionty is 
given to a valid expansion of a short literal. 

Normally register specifiers are not evaluated by the instruction unit but instead register pointers (I.e.. 
me GPR numbers) are passed to the execution unit This avoids stalls in the cases in which a previously 

/s decoded but not yet executed instruction may change the value of the register, tn an unusuaJ case of "intra- 
mstruction register read conflict" however, the GP unit will obtain the contents of a register specified by a 
register operand and place the contents in the source list This occurs when the instruction decoder 20 
detects the conflict and sends a signal to a microsequencer 83 thai is preprogrammed to override the 
normal operation of the GP unit to handle the conflict The microsequencer is also programmed to keep the 

20 instruction unit's copy of the general purpose registers in agreement with the general purpose registers in 
the execution unit These aspects of the operand processing unit are described in the tDove referenced 0. 
rite et al. U.S. patent application entitled "Decoding Multiple Specifiers fn A Variable Length Instruction 
Architecture." 

For passing register pointers to the execution unit when register specifiers are decoded, the instruction 

25 decoder has a TR bus extending to a transfer unit 84 in the operand processing unit The TR unit is 
essentially a pair of latches making up a "stall buffer" for holding up to three register pointers in the event 
of a stall condition such as the queues 23 becoming full. A specific circuit for a "stall buffer" Is shown in the 
aoove referenced Murray et at U.S. patent application entitled "Multiple Instruction Processing System With 
Data Dependency Resolution For Oigital Computers," 

jo Turning now to FIG. 8, the format for the GP bus is shown in greater detail. The GP bus transmits a 
single bit "valid data flag" (VOF) to indicate to the general purpose unit 62 whether a complex specifier has 
been decoded during the previous cycle of the system dock. A single bit "index register flag" (1RP) is also 
transmitted to indicate whether the' complex specifier reference* an index register. Any referenced index 
register is designated by a four-bit index register number transmitted over the GP bus. The GP bus also 

35 conveys four bits Indicating the speciflar mode of the complex specifier, four bits indicating the base 
register number, and thirty-two bits including any displacement specified by the complex specifier. 

The GP bus also transmits a three-bit specifier number indicating the position of the complex specifier 
in the sequence of the specifiers for the current instruction. The specifier number permits the general 
purpose unit 82 to select access and data type for the specified operand from a decode of the opcode byte. 

40 Therefore, it is possible for the general purpose unit 62 to operate somewhat independentiy of the 
expansion unit 61 and transfer unit 64 of FIG. 5. tn particular, the general purpose unit 62 provides an 
independent stall signal (OPU_STALL) which indicates whether the general purpose unit 82 require* more 
ihan one cycle to determine the operand. 

Turning now to FK3. 7, there is shown the format for the expansion bus (EX). The expa n sio n bus 

4* conveys a single bit valid data flag, the six bits of the short literal data, and a three-bit specifier number. 
The specifier number indicates the position of the short literal specifier in the sequence of specifiers 
following the current instruction, and is used by (he expansion unit 61 to select the relevant datatype from a 
decode of the opcode byte. Therefore, the expansion unit 81 may also operate rather independently and 
provides a respective stall signal (Sl__STALL) which indicates whether the expansion unit requires more 

50 'Jian one cycle to process a short Oterai specifier. 

Turning now to FIG. 8, there is shown the format for the transfer bus (TR). The TR bus includes a first 
source bus 68, a second source bus 86 and a destination bus 67, each of which conveys a respective valid 
lata nag (VOF), a register Rag (RGF) and a register number. The register flag Is set when a corresponding 
register soeofiar has been decoded. Also, whenever a complex or short literal specifier is d e co ded, then a 

55 respective one of the valid data flags in the first source, second source or destination buses is sst and the 
assoc ated register flag is cleared in order to reserve a space in the data path to the source list pointer 
queue or the destination queue for the source or destination operand. 

An entry in the source pointer queue has a format that is the same as the source 1 bus 68 (which is the 
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same as the source 2 bus 66.) Whenever a valid source 1 specifier is not a register, it is a memory source. 
When a valid source 1 pointer is a memory source, trie next free source list location pointer reoiacss tne 
register number. Similarly, whenever a valid source 2 specifier is not a register, it is a memory source. 
When a valid source 2 pointer is a memory source, me next free source list location pointer reoiacas the 

s register number. Each valid pointer is loaoed into, and will occupy, one entry in me source pointer queue. 
As many as two pointers may be loaded simultaneously. If one pointer is to be loaded, it must be me 
source l pointer. If two source pointers are loaded at once, the source t pointer will occupy me toe at on in 
me queue ahead of me location tor me source 2 pointer. This assures mat the execution unit will use me 
source pointers in me same order as the source specifiers appeared in me instruction. If mere is not 

to enough free space available for data in me source list men no source pointers are loaded. Also, no source 
pointers are loaded if me source pointer queue 23c would overflow. For generating me next free source list 
pointers in accordance with these consideration*, there is provided free pointer logic 68 in me operand 
processing unit 21 (see FIG. 3) together with a set of multiplexers 68 which Insert me free pointers into me 
respective invalid register numbers as required by me presence of valid non-register specifiers and in me 

j s absence of the overflow conditions. 

Preferably the only part of the destination pointer used for norwegister destination specifiers (i.e.. 
complex specifiers because a literal specifier will not be decoded as a valid destination), is me valid data 
flag, in other words, some other mechanism is used for pointing to me destination addresses of memory 
write specifiers. The preferred mechanism is a "write queue" 70 (see FIG. 1) In me memory access unit for 

20 queuing me physical addresses of the memory write specifiers. Therefore, when me GP unit calculates me 
address of a destination location, me GP unit transmits it to me memory access unit along with a code 
identifying it as a destination address to be stored in me write queue until the corresponding result is retired 
to memory by me retire unit 27 of me execution unit 13. Since me retire unit retires results in me same 
sequence in which they are decoded, me respective address for each result is removed from the head of 

23 the write queue when me result is retired to the memory access unit Further aspects of me write queue 70 
are disclosed in the above referenced 0. Fite et al. U.S patent application Serial No. 306.767. filed 2/3/89. 
and entitled 'Method and Apparatus For Resolving A Variable Number Of Potential Memory Access 
Conflicts in A Pipelined Computer System/ which is incorporated herein by reference. 

Turning now to FIG. 9. there is shown a schematic diagram of the source pointer queue 23c. The 

jo source pointer queue includes a set 400 of sixteen five-bit registers, each of which may hold a four-bit 
pointer and a flag indicating whether me pointer points to a general purpose register or on entry in me 
source list (24 in FIG. 1). In comparison, the program counter queue 23a and the fork queue 23b each have 
eight registers. 

To simultaneously insert two source pointers, the registers 400 each have data and clock enable inputs 
35 connected to respective OR gates 401 which combine me outputs of two demultiplexers 402. 403 which 
direct a SRC1_PTR and a SRC2_PTR and associated SRC1_ VALID and SRC2_ VAUD signals to me 
next two free registers, as selected by an insert pointer from an insert pointer register 404. The insert 
pointer is incremented by 0, 1 or 2 depending on whether none, one or two of the SRC1_ VAU0 and 
SRC2_VAU0 signals are asserted, as computed by an adder 405. 
40 To~simuttaneousty remove up to two pointers, the source pointer queue 23c includes first and second 
multiplexers 406, 407 that are controlled by a remove pointer register 408 mat ia incremented by zero, one 
or two by an adder 409 depending upon me respective pointers requested by me REMOVE_0 and 
REMOVH_l signals. 

To determine the number of entries currently in the source pointer queue, a register 420 is reset to zero 

49 when the source pointer queue 23c is flushed by resetting me insert pointer register 404 and me remove 
pointer register 40& Subtracter and adder circuits 421 and 422 increment or decrement me register 420 in 
response to- me net number of pointers inserted or removed from the queue 23c. Essentially, the number of 
entries in the queue is the difference between me insert pointer and me remove pointer, althougn the 
register 420 for me number of pointers currently in me queue also provides an indication of whether the 

50 queue is completely empty or entirety full. Oue to delay in transmitting a POINTER_QUEUe_ FULL jignai 
from me source pointer queue to the instruction unit such a POlNTER_QUEUE_FULL signal is preferably 
generated when the number of entries in the queue reaches 14, instead of me maximum number of 10, as 
determined by a decoder circuit 423. In a similar fashion, decoders 424 and 425 provide an indication cf 
* nether first and second source pointers are available from me queue. 

sa Turning now to FIG. 10. mere is shown a schematic diagram of the transfer unit generally designated 
64. me free pointer logic generally designated 6a and the set of multiplexers generally designated 89. The 
transfer unit 64 includes a parity checker 81 for returning any parity error back to me instruction cecocer 
(20 in FIG. 5) and stall buffers 32 and 83 for buffenng the transfer bus register numbers and nags. 
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respectively. The free pointer logic also includes a stall buffer 84 for buffering in a similar fashion a signal 
SL_FlRST. which indicate* whether, in the case of first and second valid non-register specifiers, the snort 
iiterlt comes before the complex specifier. This signal can be provided by a comparator 85 which 
compares the specifier number of the complex specifier to the specifier number of the short literal specifier. 

s The buffered signai SL_RRST. is used as the select to a first multiplexer 86. and also a second multiplexer 
37 after qualification by the buffered SL — VALID signal in an ANO gate 88. in order to determine the size of 
the first and second specifiers from the sixes of the complex and short literal specifiers. The sizes of the 
complex and short literal specifiers are obtained from a decoder (not shown) responsive to the opcode and 
the respective specifier numbers of the complex and short literal specifier. An adder 89 computes the total 

to size, or number of entries in the source list for storing both the complex source operand and the expanded 
short literal operand. 

The number of entries needed to store the valid non-complex specifiers in the source list is selected by 
a multiplexer 90. The select tines of the multiplexer 90 indicate whether the second and first specifiers are 
valid non register specifiers respectively, as detected by ANO gates 91 and 92 from the valid data flags and 

rs the register flags for the second source and the first source. 

in order to determine whether an overflow condition will occur if any valid non register specifiers are 
stored in the source list a subtracter 93 compares the position of the head of the queue, as indicated by 
the value EBOX_LAST_ POINTER, pointing to the value of the next FHEE POINTER A comparator 94 
detects the potential overflow condition when the size to allocate exceeds the number of slots available. The 

20 signal from the comparator 94 is combined with a QUEUES FULL signal in an OR gate 95 to obtain a signai 
indicating that the source list is full or the source pointer queue is full 

The free pointer is kept current in an accumulator including a pair of latches 96 and 97 activated by 
non-overlapping A and B clocks, and an adder 98. The free pointer, however, is not incremented by the 
SlZE_TO_ ALLOCATE in the event of the source list becoming full or during an initialization cycle. An OR 

25 gate 97 and a multiplexer 98 insure that the free pointer doee not change its value under these conditions. 
Ouring a flush, for example, the INIT_FPL signal is asserted and the EBOX_LAST_ POINTER signal is set 
equal to the value of the FREE_ POINTER signal. The EB0X_LAST_ POINTER signal is provided by a 
counter (not shown) in the execution unit 

in the event that the queues are too full to allocate sufficient size in the source list for the current valid 

30 non«f egister specifiers, then the transfer unit must stall In this case the valid flags are set to unasserted 
values by a gate 99. The gate 99 also sets the flags to their unasserted state during an initialization cycle 
when the INIT^FPL signal is asserted. The valid Rags are transmitted to the source pointer queue through 
an output latcrTioo. In a similar fashion, the two source pointers and the destination pointer from the set of 
multiplexers 69 are transmitted through an output latch 101. 

:s Turning now to FIG. 1 1 , there is shown a schematic diagram of the expansion unit generally designated 
61. The expansion unit takes the decoded short literals from the instruction decoder and expands them for 
insertion into the 38-bit entries of the source list The actual expansion performed depends on the data type 
of me specifier. In particular, a multiplexer 120 selects either an integer, F and 0 floating point 0 floating 
point or H floating format depending on the datatype of the specifier. At least for the first data word, the 

40 format is provided by combinational logic 121 known as a short literal formatter. For data types requiring 
additional 32-bit data words, the additional words are filled with zeros. 

Ouring a stall, the multiplexer 120 also selects the previous expansion to hold its state. The select lines 
of the multiplexer 120 are provided by an expansion select decoder 122 responsive to the short literal data 
type which is held in a stall buffer 123 during stalls. The expansion select decoder is also responsive to 

44 whether the first or some other long word of the expansion is currently being generated. This condition is 
provided by a gate 124 that detects whether the number of outstanding long words is different from zero. 
The number of long words required for the expansion is provided by a decoder 125 responsive to the aata 
rype of the short literal. The required number of long words is counted down by an accumulator Including a 
pair of latches 126. 127 and decrement logic 128. The accumulator includes a multiplexer 129 for initialing 

so setting the accumulator, clearing the accumulator, or holding its value in the event of a stall The next state 
of the accumulator is selected by combinational logic 130. A gate 131 generates a short literal stall signal 
whenever the exoansion must continue during the next cycle, as indicated by the next state of the 
accumulator. In other words, the stall signal is asserted unless the outstanding number of long words is 
zero. 

53 Turning now to FIG. 12 there is shown a schematic diagram of the general purpose (GP) unit The 
general purpose unit needs two cycles for the computation of a memory address specified by index (X). 
base 00 and displacement (0) specifiers, in the first cycle, the contends of the base register are added to 
the displacement In the second cycle, the contents of the index register are shifted by 0, 1, 2 or 3 bit 
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position* depending upon whethsr the indexing operation is for * byte, word, long word or quad word 
context respective*/ and added to the previous result This shifting is performed by a shift multiplexer 141. 
The value of the base register is selected by a multiplexer U2. and the value of the index register is 
selected by a multiplexer 143. In the first cycle, the content of the selected base register is fed through 

s another multiplexer m to an intermediate pipeline or stall register 143. and similarly the displacement is 
selected by still another multiplexer 146 and after a shift of 0 positions, and after being transferred through 
the shift multiplexer 141 is received in a second intermediate pipeline or stall register 147. The base and 
displacement are then added in an adder 1 43 and the sum is fed back through the multiplexer 144 to the 
pipeline register 145. At this time, the multiplexer 148 selects the index register value instead of the 

io displacement the shifter 141 shifts the value of the index register in accordance with the context of the 
indexing operation, and the shifted value is stored in the second intermediate pipeline register 147. Ouring 
the computational cycle, the adder 148 adds together the contents of the two pipeline registers us and 

147. 

The GP unit is controlled by a sequential state machine including combinational logic 1 50 and a two-bit 
is state register 151 defining four distinct states, it cycles back to state zero after completion of the operand 
processing an instruction. When given a grant signal from the instruction decoder and so long as a stall 
condition is absent the GP unit may issue a memory access request and cycle through its states until 
completion of the operand processing for the instruction. Aside from the grant and stall signals, which could 
be thought of as inhibiting the counting of the state register 151 and the request or transmission of data by 
20 the GP unit the combinational logic 150 can be defined by a state table having nine input bits, consisting of 
four bits wnicft define combinations of the specifier mode, three bite which specify the specifier access 
type and the two bits from the sate register 1 5 1. The four bits defining the combinations of the specifier 
mode (0* Oj 0*. 0, ) are obtained from the five bits (PC, M4, M3, M2. Ml) which define the specifier 
modes according to: 04- PC. Oi » N0T(M4), 02 -(M4 ANO M3) OR M2. and 01 -M1. Therefore the four 
25 bits (04, 03. 02. 01) are related to the specifier modes as shown in the following Table I: 



30 



J3 



*S 



12 



EP 0 381 471 A2 



TABL2 I. 



s 



to 



PC 


Hi M3 


H2 Ml 


1 04 03 


02 


01 




0 0 


0 0 


d d 


d 


d 


n 


0 0 


0 I 


d d 


d 


d 


a 


VI V 


i n 


A A 

a a 


C2 


CI 


0 I 


o rt 

VJ u 




A A 


A 


Ci 


a 


0 1 


a a 


A A 


A 


a 


0 


0 1 


0 I 


0 1 


o 




0 I 


0 1 


L 0 


0 1 


1 


o 


o | 


0 1 


L I 


0 1 


X 


X 




1 0 


0 0 


0 0 


0 


0 




1 0 


0 I 


0 0 


0 


I 




1 0 


1 0 


0 0 


X 


0 




i 0 


1 I 


0 0 


1 


X 




1 1 


o a 


0 0 


X 


0 




1 1 


0 1 


0 0 


X 


X 




1 I 


l 0 


0 0 


X 


0 




I 1 


t 1 


0 0 


X 


X 




0 0 


0 0 1 


d d 


d 


(1 




0 0 


0 1 1 


d d 


d 


d 




0 0 


1 0 | 


d d 


d 


d 




0 0 


1 X 1 


d d 


d 


d 




0 1 


0 0 ! 


d d 


d 


d 




a l 


0 I i 


1 1 


0 


X 




0 1 


1 0 


1 1 


X 


0 




0 1 


1 1 1 


1 1 


X 


X 




X 0 


0 0 ! 


1 0 


0 


0 




1 0 


0 I I 


1 0 


0 


X 




I 0 


1 0 | 


1 0 


X 


0 




1 0 


1 X ! 


i a 


X 


X 




X 1 


0 0 | 


1 0 


I 


0 




1 1 


0 X 1 


x o . 


X 


X 




1 1 


1 0 | 


X 0 


X 


0 




1 1 


1 1 I 


X 0 


i 


- X 



non-PC «od«t ••••• 

• lit * OPU doafn' t handia 
jXit - OrU do«in' C htndlc 
Jiit - OPU doam't htndXe 
sXit - OPU doesn' t handle 
indexed - not by ItselCI 
register 

register deferred 
autodocreieent 
autolncrament 
autoinc deferred 
byte dXtp -> disp 
byte ditp dec* -> dXsp def 
word dXsp -> dijp 
weed dijp del -> dijp def 
Xwerd dijp •> dijp 
Xword dijp de£ -> di$p def 
!•••*«•••• pg nodes 
slit - OPU dostii' t handie 
Jilt - OPU doesn't handle 
Jlit - OPU doesn't handle 
sXit - OPU doesn't hmdlt 
indeied - not by Itselfl 
PC as IXn -> UHPRCOCCTABtC 
PC as (On) -> l/NPflXO ICTAflLC 
PC as - (FUl) -> UIIPOCO. 
immediate 
absolute 

byte relative -> relative 
bytt rel def -> rei def 
word relative -> relative 
word r«X def -> raX def 
Xword raXatlva -> relative 
Iword raX dac •> caX def 



With this implementation the preferred combinational logic 150 is defined by the foitowing state sequence* 
in Table II: 
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' indicate* a guaranteed stall cycla 



It should bo noted that from trie above Table II. the sequence of operations selected by the combinational 
logic 150 depend* upon the specifier mode and the specifier access type. For the intersection of any 
specifier mode and any specifier acce** type in the table, it can be seen that there is a sequence of up to 

so no more than three operttions although there could be up to two guaranteed stall cycles. Therefore, state 
zero of the state register 151 can define the idle state of the machine, and states 1. 2 and 3 can define the 
sequence of the 3 state* in which the machine is actually performing an operation. 

Referring now to FIG. 13, there Is shown a block diagram of the execution unit which show* the now of 
control signals between the various component* in the execution unit Assume, for axamoie. '.hat the 

55 execution has been initialized so that it i* in an idle state. Even during this idle state, the execution unit s 
looking for valid source operands as indicated by valid data flags at the head of the source pointer queue. 
The microcode enables the source pointer removal logic 1 61 to pas* the source pointers at the head of the 
queue to source validation logic 183. in the event of the source pointers indicating the presence of a vaud 
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non register source specifier, me source validation logic 163 checks the states of respective vaikJ bits 
ass o ci a t e d with the entries in the source list pointed to by the source pointers. In the event that the valid bit 
is asserted, the source validation logic 163 asserts a SHC_OK signal to the issue unit 25. which is uncer 
the control of the microcode execution unit 28. 

s When the issue unit 25 determines that there is a next fork at the head of the fork Queue, it issues a 
now fork signal to the microcode execution unit 28. The microcode execution unit thereby resoonds by 
returning the microcode word at that fork address. The first word, for example, instructs the issue unit to 
transmit the validated source data from the source list in the case of a valid norwegtster specifier, or from 
me specified general purpose register or registers. The microcode word, for example, specifies the 

io particular one of the multiple functional units to receive the source data. The multiple functional units 
include, for example, an integer unit 184, a floating point unit 165. a multiply unit 168. and a divide unit 167. 
The integer unit for example, has a 32 bit arithmetic logic unit a 64 bit barrel shifter, and an address 
generation unit for producing a memory address every cycle, and therefore executes simple instructions 
such as a move long, or add long, at a rate of 1 per cycle and with tittle microcode control. Complex 

'* instructions such as CALLS, and MOVC are done by repeated passes through the data path of the integer 
unit For these instructions, the microcode controls access to the data path resources in the execution unit 
Due to the use of multiple functional units, a single integer unit is sufficient to keep up with the peak flow of 
the integer instructions. Complex instructions, for example, do not (end themselves to concurrency due to 
the memory interactions inherent In string manipulations and stack frames. While microcode executes these 

20 instructions, other functional units would be idle. 

The floating point unit 1 65 executes floating point operations such as AOO, SUB. CMP. CVT, and MOV 
for F, Q and 0 floating formats. It is pipelined, so it can accept instructions as fast as the issue unit can 
issue and retire them. Although it gets the source operands in 32-bit pieces, it has a 84 bit data path 
internally. The floating point unit is further described in the above referenced Fossum et al.. U.S. Patent 

23 Application entitled "Pipelined Floating Point Adder For dgttal Computer." 

The multiplier 166 is preferably a pipelined multiplier that performs both integer and floating point 
multiplications. 

The divider 187 does division for both integer and floating point and is not pipelined to save logic and 
because it is sufficiently fast The divider, for example, does a division in twelve cycles, even for 0 and Q 

30 floating point formats. 

For the instruction having been issued, it is assumed that the operation requires a destination for 
retiring the result Moreover, it is possible that the destination pointer for the result will be Inserted in the 
destination pointer queue 23e some time after the source specifiers are validated. When a destination is 
expected, the microcode enables destination pointer removal logic 171 to remove the destination pointer 

as from the head of the destination pointer queue and to insert the destination pointer into a result queue 1 72, 
along with information identifying a particular one of the multiple function units 22 that is to provide the 
result It is also possible that the issue unit may have issued an instruction that does not have an explicit 
destination specified in the instruction. The instruction, for example, may require the use of the execution 
temporary registers (43 in FIG. 4). In this case, some or possibly ail of the destinations for the instruction 

*o could be known to the rnicrocode execution unit 28. Therefore, in this case the issue unit 25 could toad the 
result queue at the very beginning of execution of the Instruction. 

As noted above, the ex ec u tio n unit is designed to retire the results of Instructions in the same sequence 
in which the instructions appear in the instruction stream. The same would be true for intermediate 
operations by microfloras making up the macro instructions in the instruction stream. Therefore, in addition 
to the advantage that memory write results can be retired at memory addresses specified in the write 
queue it is also possible to use a result queue 172 to alleviate the issue unit of the burden of keeping track 
of when the multiple functional units actually complete their processing. Instead, the task of retiring the 
results can be delegated to a separate retire unit 173. 

The retire unit 173 monitors the destination information at the head of the result queue, and in particular 

so monitors the result ready signal selected from the particular functional unit Indicated by the functional unit 
specification in the entry at the head of the result queue. Upon receipt of that result ready signal, the retire 
unit can retire the result in the fashion indicated by the information in that head entry in the result queue. In 
sedition to the actual location normally Intended for the result the retire unit may check condition codes, 
such as underflow or overflow, associa t ed with the result and depending upon the condition codes, set trap 

ss enable Mags to cause the microcode execution unit to handle the trap. For memory destinations, the retire 
unit ensures that the result is sent to the memory unit For results including multiple 32-bit tongwords. for 
example, the retire unit maintains a count In a register 174 to ensure that the entire result is retired before it 
goes on to retire any next result at the head of the result queue. Also, if the retire unit encounters any 
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difficulty in retiring results, it could, for example, enable stall logic 175 associated with the issue) unit to 
perform a stall, trap, or exception in order to correct the problem. 

Turning now to FIG. 14. there is shown a block diagram of the preferred data paths in the execution unit 
1 3. Each functional unit haa a data path for retiring results that terminates at the retire unit The result from 

s the functional unit indicated by the result queue entry at the head of the queue is called 
•RETlflE_ RESULT* which is selected by a retire multiplexer 185. The RETIRE^ RESULT is fed to a 
central data distribution network generally designated ISO. The retire unit 27 also haa a pair of data paths 
for sending results to the copy of the register file in the instruction unit 1 2 and to the program counter (1 7 in 
FIG. i) in the instruction unit for flushes. The retire unit also haa a data path directly to the memory access 

io unit n. However, when the execution unit receives data from the memory access unit 1 1 . the data are 
always transferred from the memory access unit to one of the sixteen memory temporary locations or one 
of the sixteen source list locations in the register file 40. This is true even if the data are immediately used 
by the execution unit as soon as it is available from the bus 182 between the memory access unit 1 1 and 
the execution unit 13. In other words, even if a bypass gate is enabled to get the data from the bus 182. the 

, 9 data are written into the register Hie 40. When the execution unit does a memory read, it first invalidates a 
specified location in the memory temporaries m the register file 40 by clearing a respective 'valid data bit", 
then requests the memory access unit to fetch data from a specified address and transmit it to the specified 
memory temporary location, and finally waits for the respective valid data bit to become set The memory 
access unit writes to the respective "valid data bit" to set it when it transmits fetched data to a s pea fled 

30 memory temporary location. The "system reset - clears or invalidates all of the 'valid data bits* in the 
memory temporary registers. 

Turning now to FIG. 15, there is shown a timing diagram of the states of the various functional units for 
executing some common instructions. The fact that these instructions require various numbers of cycles to 
complete, and also due to the fact mat they require different numbers of retire cycles, ail indicate that the 

29 use of the result queue and the retire unit relieves the microcode and issue logic of a substantial burden of 
waiting for the results to retire and retiring them accordingly. The advantage is even more significant when 
one considers the interruption of the normal processing by the functional units due to contention for access 
to the memory unit FIG. 15 also shows that the operating speeds of the various functional units are fairly 
well matched to the frequency of occurrence of their respective operations. This is an important design 

jo consideration because if one unit does not retire, the other units will be stalled with their results waiting in 
their output buffers, and in the case of pipelined functional units intermediate results waiting in intermediate 
pipeline registers. Such a system is fairly wed optimized if no one functional unit is more likely than another 
to stall the other functional units. Turning now to FIG. 18, there is shown a flowchart summarizing the 
control procedure followed by the execution unit to issue source operands and requests to the functional 

:s units, in step 201. the microcode execution unit detects whether a new operation is required. If not no use 
of the functional units or the result queue is necessary in the current cycle. Otherwise, in step 202 the 
microcode execution unit checks whether the functional unit for performing the new operation is busy and 
therefore cannot accept new source operands. 

If the functional unit la busy, then processing of the request is finished for the current cycle. Otherwise, 

40 in step 203 the microcode execution unit tests whether source operands are available to be transferred to 
the required functional unit If not servicing of the request is completed for the current cycle. Otherwise, the 
execution unit determines in step 204 whether the destination is known, ff not processing is finished for the 
current cycle. Otherwise, In step 205. the microcode execution unit inserts a new entry into the result queue 
which identifies the required functional unit and includes ail of the information needed for retiring the result 

*a from that functional unit After step 205 is completed, the microcode execution unit need not be concerned 
about the processing of the requested operation or the retiring of the result All of that can be monitored by 
me retire unit and rf the retire unit detects a problem that needs the assistance of the microcode execution 
unit then it can Initiate an appropriate stall, trap, or exception to transfer control of the problem to the 
microcode execution unit 

so Turning now to FK3. 17. there is shown a flowchart of the control procedure followed by the retire unit 
for retiring results and servicing the result queue. In a first step 21 1 the retire unit checks whether the result 
queue is empty. If so. then its servicing of the result queue Is completed for the current cycle. Otherwise, in 
step 212, the retire unit tests whether a resuft is available for the request at the head of the result queue. In 
ether words, the retire unit obtains the Information in that entry identifying me functional unit assigned to the 

5* request and tests the result ready signal from that functional unit If that result ready signal is not asserted, 
then the servicing of the result queue by the retire unit is finished for the current cycle. Otherwise, in step 
213 the retire unit looks at the destination information in the entry at the head of the result queue and 
cnecks whether that indicated destination is available, if not .then servicing of the result queue by the retire 
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unit is finished for the current cycle. Otherwise, in step 214 the ream unit can initiate trie retirement of the 
result in accordance with the in form ad on in the entry at trie heed of the result queue. Once the result is 
retired, then in steo 215 the retire unit may change (he state of the execution unit to reflect that fact by 
removing the entry at the head of the result queue. After the entry has been removed from the head, the 
s retirement of that result is completed. 

Turning now to FIG. 18. there is shown a diagram of a preferred format for an entry in the retire queue. 
The entry, for example, include* 27 bits of information. The first three bits <28:24> specify a AET1RE — TAG 
which selects a particular one of the functional units from which to receive the next result to be retired. 

Bit 23. there is a Hag indicating whether the result is supposed to be written somewhere, instead, for 
io example, of just setting selected condition codes and being acknowledged by a result used signal (see FIG. 
12) so that the functional unit is free to produce a result from a new set of operands. 

Bit 22 is a memory destination flag indicating whether the result will be written to memory. There is no 
need for the entry in the result queue to indicate the memory address, since that memory address should, 
under usual circumstances, already have been translated to a physical memory address and be waiting for 
is the result 

Bits <21--2Q> designate a context field CTX indicating whether the result context is byte. word, long 
word or quad word. For the case of a quad word, for examoie. two cycles are required to retire the quad 
word over the 32 bit data lines, and therefore two cycles are required for retirement The byte and word 
context can be used for performing a byte or word write into a 32 bit register or memory location. 
20 The four bit field UCCK < 1 9:1 S> is a set of Mags indicating how the condition code bits of the execution 
unit are to be updated. These nags, for example, enable or disable the negative bit the zero bit the 
overflow bit and the carry bit of a processor status word. 

The four bit field UTHAP_EN <1S:12> is a set of four trap enabling bits for enabling or disabling 
respective trap conditions. 
25 Bit 1 1 is a flag ULAST which marks the end of a macro instruction. 

Bit 10 is a flag U MAC ROB which marks the end of macro branches. 

Bit 9 is a flag UMB4_WAJT which, when enabled, requires the retire unit to wait for acknowledgement 
of a successful memory write before completing subsequent retirement operations. 

Finally, in bits <8:0> there are nine bits designating a selected location 0EST__SEL in the execution 
zo unit for receiving the result These locations, for example, are the general purpose registers or any other 
registers in the execution unit that are capable of receiving a result 

Claims 

35 

1. A method of preprocessing and executing multiple instructions in a pipelined processor, the 
instructions including opcodes and operand specifiers, the pipelined processor including multiple and 
separate functional units (164. 165, 166, 167) for executing various classes of instructions, the method 
comprising: 

40 decoding the instructions to obtain the opcodes and operand specifiers: 
fetching source operands specified by the operand specifiers; 

issuing tne source operands to the respective functional units as indicated by the decoded opcodes, and 
operating the functional units in parallel to execute the various classes of instructions; and 
•etiring results from the respective functional units. 
*6 2. A method as claimed in claim 1. wherein the classes of instructions executed in parallel by the 

respective functional units include integer instructions, floating point instructions, multiply instructions, and 
divtce instructions. 

3. A method as claimed in claim 1 or 2. wherein the source operands are Issued to the respective 
functional units by a microcode controlled instruction issue unit (25). 
so 4. A method as claimed in claim i. 2 or 3 further compnsing inserting an entry into a result queue (172) 
wren an instruction is issued to a functional unit the entry Indicating the particular functional unit and the 
destination for the result of the functional unit 

5. A method as claimed in claim 4, wherein the entry is inserted Into the result queue in resoonse to a 
signal from a microcode execution unit (26) when the microcode execution unit determines that a new 
» operation is required, the respective functional unit is not busy, the source operands are available, and the 
destination for the result is known. 

3. A method as claimed in claim 4 or S. wherein the entry includes a flag indicating whether the result is 
to be written into memory. 
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7. A method as claimed' in claim 4. 5 or 8 wherein the entry includes a context fletd indicating the result 
context 

8. A method as claimed in any of claims 4 to 7 wherein the entry includes flags for enabling condition 
codes. 

s 9. A method as claimed in any of claims 4 to 3 wherein the entry includes a flag that marks the end of 
a microinstruction. 

10. A method as claimed in any of claims 4 to 9. further comprising retiring the result from the 
functional unit indicated by the entry at the head of the result queue when the result is available and when 
the destination indicated by the entry is available. 
to 1 1. A method as claimed in claim 10. further comprising removing the entry from the head of the result 
queue when the result is retired. 

12. A method as claimed in any preceding claim, wherein the results of instructions are retired in the 
same sequence in which the instructions appear in the instruction stream. 

13. A pipelined processor for preprocessing and executing multiple instructions, the instructions 
is including opcodes and operand spec Men. the processor including means (20) tor decoding the instructions 

to obtain the opcodes and the operand specifiers, means (21) for fetching source operands specified by the 
operand specifiers, multiple and separata functional units (164. 1 65. 166. 167) for executing various classes 
of the instructions, means (25) responsive to the decoded opcodes for issuing commands and source 
operands to the respective functional units to initiate parallel execution of the various classes of instructions. 
20 and means (27) for retiring results from the respective functional units. 

1 4. A pipelined processor as claimed in claim 1 3. wherein me means for issuing commands and source 
operands includes a microcode controlled issue unit (25). 

15. A pipelined processor as claimed in claim 14, wherein the functional units include an integer unit 
(164) controlled by the microcode, the other functional units being controlled independently of the 

25 microcode. 

16. A pipelined processor as claimed in claim 1 3 or 14, wherein the functional units include an integer 
and shifter unit (164). a floating point unit (165), a multiply unit (166) and a divider unit (167). 

17. A pipelined processor as claimed in claim 16 wherein the integer and shifter unit is controlled by 
microcode. 

oo 18. A pipelined processor as claimed in claim 17, wherein the floating point unit the multiply unit and 

the divider unit are not controlled by the microcode. 

19. A pipelined processor as claimed in any of claims 13 to 19. wherein the means for retiring results 

from the respective functional units includes a result queue (172), means for loading entries into the resuit 

queue, identifying respective functional units and respective destinations for their results, and means (173) 
35 for retiring results from respective functional units and to respective destinations as indicated by the entries 

in the result queue. 
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